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ABSTRACT 

A test measuring test wiseness was administered to 811 
pupils in grades 3, 5, and 7 in the Tucson Onifiei School District, 
The pupils represented four ethnic groups: American Indian, Angls, 
Black, and Hispanic, By controlling for reading ability using scores 
on a standardized reading test, the California Achievement Tests 
(CAT) or Comprehensive Tests of Basic Skills (CTBS) , as a covariate, 
significant sex-by-ethnicity interactions were found- The use of 
reading comprehension as a covariate resulted in findings 
substantially different from previous research or from what may be 
concluded from looking at obtained testwiseness scores as a dependent 
variable. Due to small numbers of pupils in some groups and 
inconsistencies across grades, specific group results were regarded 
as extremely tentative, (Author/RL) 
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ABSTRACT 

A test measuring testwise: ::ss wes administered to 81 ; pupils - .■.he- 
third, fifth, or seventh grades ~n the Tucson Unified School Ci-tri 
The pupils represented four ethnic croup : American Indian, /ng1o 5 
Black, and Hispanic. By controlling for reading ability usirtc scores 
on a standardized reading test (CAT sr CTBS) as a covariate, we were 
able to find significant sex-r-y-ethnic'ty interactions. The use ~~ 

/ 

reading comprehension as a covariate faulted in 'findinns suhstar ; ~1 ly 
different from previous research cr fm what we would conclude f-c;-n 
looking at o^ained testwiseness score:, as a dependent variable, due 
to small numbers of pupils in some groups and inconsistencies across 
grades, we must regard specific group results as extremely tentative. 
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An In stigaticn ir Etirnr Srou? . ^rences 
in r :Stv isene3S t: the ~~~rd 3 F ™ and 

Introcjct-' on 

Test iseness (TV Wc3 c irs": ^.i^nf-^ei a: a poss* ::le effec~:r of reliability 

by Thorncike (1951). viable roncen-i.a'i franewor 5 ' fcr the conr-ru:t vas 

provided by Millman, ; is nop and Ebel i'"~965) whose iefinition of TW :s 

employed in this stury: 

a subject's capacity to ut V th~ : racterist . cs and formats 
of the test and/or the test-tc. :'~ng z nation to ^ceive a h gh 
score. 

Researchers have shown that TW can be ^e~:..:-=d (Gib^ 5 554; Million. ;r66; 
Slakter et al . , 1970a; Woodley, 1972 I:£jr-;;;rnrit r 1975-;, that TV can be 
taught (Gaines and Jongsra, 1974; Sarnzr;: 1979), and nhat training in TW 
skills improves performance on tests c^si— to measure TW (Gibb, 1964; 
Slakter et al. f 1970a; Moore, Schutz, snd . jac:er 1966; Langer et al.. 1973). 
More relevant to the purposes of tfrs szuz'\ r researchers have shown that 
instruction in TW raises the scores zf rzjusits measured on standardized 
tests such as the Comprehensive Tesrs c-'7«sr5c Skills (Gaines and Jongsma, 
1974), the Stanford Reading Test (Csllencacn. 1973), the Metropolitan Readiness 
Test (Oakland, 1972). 

The purposes of this study weir., (~ ~ compare the testwiseness of four 
ethnic groups— American-Indians , B"rrk, Ki— anic and Anglo, (2) to compare 
the testwiseness of male and female students and (3) to investigate any inter- 
action between ethnicity and sex at the third, fifth, and seventh grade levels. 
Because previous research has found significant positive correlations between 
TW and verbal ability (Diamond and Evans, 1972), reading ability was used as 
a covariate. 
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Method 

Sample . Thirty-nine teachers and 1,128 students at the third, fifth 
and seventh grade levels of the Tucson Unified School District participated 
in this study. Five junior high schools and thirteen elementary schools 
-/ere represented in this study. Schools v/ere selected in order to obtain 
representative eti:nic groups and to obtain representative geographical 
areas of Tucson, The initial group was reduced to 811 when only those 
students with complete data sets were included in the analysis. The ethnicity 
and sex of the participants are presented in Table 1. 

Table 1. Participants in the Testwiseness Study 





Third 


Fi f th 




Seventh 




Ethnicity 


M 


F 


M 


F 


M 


F 


Total 


American Indian 


4 


4 


4 


1 


7 


10 


30 


Black 


12 


9 


6 


3 


5 


13 


48 


Hispanic 


42 


35 


70 


71 


95 


81 


394 


Anglo 


22 


36 


51 


57 


91 


82 


339 


TOTAL 


80 


84 


131 132 


198 


186 


811 


Instrumentation. 


Four 


areas 


of TW were 


selected 


from Mi 11 man 


et al . , 



1965. These areas had been used in previous TW research (Crehan et al . , 1978; 
Crehan et al., 1974; Slakter et al., 1970a; Slakter et al . , 1970b). As stated 
by Millman et al , : 

The examinee should be able to 

1. Select the option which resembles an aspect of the stem. 

2. Eliminate options which are known to be incorrect and to 
choose from among the remaining options. 

3. Eliminate similar options; i.e., options which imply the 
correctness of each other. 

4. Eliminate those options which include specific determiners. 
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The general approach to the construction of a TW test was adapted from 
Slakter. Items 1-10 contained five items which measured risktaking. The 
remainder of the test (items 11-26) measured testwiseness subdivided into 
four subscales: (1) Stem Option Resemblance (items 11, 15, 19, 23), 
(2) Absurd Options (items 12, 16, 20, 24), (3) Similar Options items 13, 17, 
21, 25), and (4) Specific Determiners (items 14, 18, 22, 26). ':tew items were 
written to be relevant for third through seventh grade students. Items were 
written with a simple vocabulary to produce a TW Test which would be more 
valid for the majority of students who were below average in reading ability. 

Procedure . TW tests were administered to participants in third, fifth 
and seventh grades by their teachers who volunteered to participate in this 
study. Teachers previously received two hours of inservice about testwiseness 
principles which included procedures for administering the TW test. 

Analysis . The following variables were analyzed in this study: 

1. Readin g Comprehension was measured by the California Achievement 
Test, Book 1 3D, Reading Comprehension subtest (with third grade 
participants), the Comprehensive Tests of Basic Skills, Form S, 
Level 2, Total Reading Test (with fifth grade participants), and 
the California Achievement Test, Book 17C, Reading Test (with 
seventh grade participants). The fifth and seventh grade 
reading tests had been administered as part of a districtwide 
testing program in the fall of 1980. 

2. Risktaking and Testwiseness as measured by the Standard ^ Educati onal 
Test developed by the authors and previously described in this ~™ 
paper. 

3. Sex (Male, Female) 

4. Ethnicit y (American-Indian, Black, Hispanic, Anglo) 

Data were analyzed using a multiple regression approach with three dummy 
variables representing ethnicity and one dummy variable representing sex. 
Three variables were created to represent the ethnic by sex interaction term. 



6 



4 



Reading sec *rs were Altered ~i :z ~n the equation followed by eth rr\ ity, 
sex and eth ity ;< vax interc — rn terms (for more informs :ion rn - - : 
approach, re-" r to lerlinger e : ~~dhazur, 1973 ; Chapters 6-11). 
Results 

Alpha c:: fficients (Cr;:nt_n " 951) were computed for each sj:-: r 
of the TW ter; as we* - -3 for :~t~ total test. Refer to Table 2. 

Table 2. Reliibilit; [Alpha) --sufficients for Subscales of the TesT- 
wiseness T? ?st 



Grade 


Risk 


3~=m 
™ion 


Absurd 
Option 


Similar 
Option 


Specific 
Determiner 


Tc-al 
ScLle* 


3 


.88 


.23 


.32 


.02 


.08 


.38 


5 


.70 


.37 


.46 


.06 


.12 


.54 


7 


.39 


.24 


.21 


.18 


.08 


.41 


♦Total 


scale is Iter 


■1-26. 











Slakter et al . 1970a, p. 120) reported for his test of testwiseness 
the following median reliability for the same items administered across 
Grades 5-11: Stem-option subscale, .31; absurd-options subscale, .25; specific- 
determiners subscale, .08, and the similar-options subscale, .46. The median 
reliability of the total TW measure was .44. 

Crehan et al . (1978, page 42) reported KR-20 reliabilities in. a cross- 
sectional analysis for total TW score for fifth grade .40 and .41 and for 
seventh grade .44 and .51. We agree with Crehan et al . (1978) that the 
reliabilities are not high, but for a scale of 16 items, they were adequate 
for detecting group differences. 
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A multiple regression analysis \h computed for third grade students on 
ie first step of each re res si on ana :is, reading scores were entered to 
ontrol for that variab'- Ethnic grcups did not differ significantly , 
r (1,159) = 1.18. Sex r Terences in iast nseness did occur, F (1,161) = 5.66 
o = .019* Of spe " • -rerest in this -es xh was an etnnicity by sex inter- 
action, F (3,155) --- :. ;, p = .048. ~ Tables 3-5. A graph of the 
interaction is pre;-- c in Figure 1. Re-L-ng means for third, fifth and 
seventh grades a™ anted in Appendix . 

Table 3. Regr^si; , r Testwiseness S,rrr=s on Ethnicity, Sex and E x S 
Intrr-ct rr rith Reading Scc:^: as Covariate for 164 Third 
Grace Stuif :s 



Sou re 


R 2 


df 


F a 


P 


Covariate 


.197 


1,162 


39.86 


.000 


Ethnicity 


.215 


3,159 


1.18 


.319 


Ethnicity + S=-c 


.249 


1,158 


7.15 


.003 


Sex 


.225 


1,161 


5.66 


.019 


Sex + Ethnicity 


.249 


3,158 


1.70 


.169 


Sex + Ethnicity + E x S 


.286 


3,155 


2.70 


.048 



Interaction^ 



Each F ratio is computed only for the last variable entered into the 
regression equation. 

'Tests for covariate by ethnicity interaction, F (3,156) = .63 and 
covariate by sex interaction, F (1,160) = 1.04 were nonsignificant. 
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Table 4. Testvn'seness Means Adjusted for Reading Scores 
for 164 Third Grade Students 3 



Ethnicity 


Male 


Female 


Total 


American Indian 


8.86 


9.06 


8.96 


Black 


10.16 


7.85 


9.17 


Hispanic 


9.04 


8.94 


8.99 


Anglo 


10.40 


9.09 


9.59 


TOTAL 


9.57 


8.89 


9.23 


a The regression weight (b weight) used in the adjustmen 
process was .1560. 


Table 5. Testwiseness Obtained 
Third Grade Pupils 


Score Means 


for 164 


Ethnicity 


Male 


Female 


Total 


American Indian 


7.50 


8.25 


7.88 


Black 


10.25 


7.33 


9.00 


Hispanic 


8.93 


9.14 


9.02 


Anglo 


10.18 


9.50 


9.76 


TOTAL 


9.40 


9.06 


9.23 



d 



8 



7.35 



M F 

Figure 1. Testwiseness Adjusted Means of Third 
Grade Students 

A regression analysis was carried out for the fifth grade students. 
There were no significant differences among ethnic groups, F (3,258) = 1.57. 
Moreover, there were no sex differences in testwiseness, F (1,260) = .49, 
and no ethnic by sex interactions, F (3,254) = 1.19. See Tables 6-8, and 
Figure 2. 
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Table 6, Regression of Testwiseness Scores on Ethnicity, Sex and E x S 
Interaction with Reading Scores as Covariate for 263 Fifth 
Grade Students 



Source 


R 2 


df 


F a 


P 


Covariate 


.154 


1 ,261 


47.56 


.000 


Ethnicity 


.169 


3,258 


1.57 


.196 


Ethnicity + Sex 


.171 


1,257 


.65 


.420 


Sex 


.158 


1 ,260 


.49 


.485 


Sex + Ethnicity 


.171 


3,257 


1 .62 


.184 


Sex + Ethnicity + E x S 


.183 


3,254 


1.19 


.313 



Interaction 



a Each F ratio is computed only for the last variable entered into the 
regression equation. 

b Tests for covariate by ethnicity interaction, F (3,257) = 1.05 and 
covariate by sex interaction, F (1,259) =2.09 were nonsignificant. 



Table 7. Testwiseness Means Adjusted for Reading 
Scores for 263 Fifth Grade Students 8 



Ethnicity 


Male 


Female 


Total 


American Indian 


9.64 


8.94 


9.50 


Black 


9.44 


6.48 


8.45 


Hispanic 


9.96 


9.77 


9.87 


Anylo 


9.54 


9.51 


9.52 


TOTAL 


9.76 


9.58 


9.67 



a The regression weight (b weight) used in the adjust- 
ment process was .0566. 



Table 8. Testwiseness Obtained Score Means for 263 
Fifth Grade Students 



Ethnicity 


Male 


Female 


Total 


American Indian 


9.25 


8.00 


9.00 


Black 


8.50 


5.33 


7.44 


Hispanic 


9.77 


9.52 


9.65 


Anglo 


9.80 


10.02 


9.92 


TOTAL 


9.71 


9.63 


9.48 




Figure 2. Testwiseness Adjusted Means of Fifth 
Grade Students 
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A regression analysis was computed for seventh grade students, Male 
and female students were different on testwiseness , F (1,381) = 8-49, p = .004. 
Ethnic differences, F (3,379) * 2.48, p = .061, and ethnicity by sex inter- 
action were not significant, F (3,375) = 2.51, p = .051. Sec Tables 9-11 
and Figure 3. 

Table 9. Regression of Testwiseness Scores on EVnnicity, Sex and E x S 
Interaction with Reading Scores as Ccvariate for 384 Seventh 
Grade Students 



Source 


R 2 


df 


F a 


P 


Covariate 


.062 


1,382 


25.18 


.000 


Ethnicity 


.080 


3,379 


2.48 


.061 


Ethnicity + Sex 


.097 


1,378 


V.23 


.ooa 


Sex 


.082 ' 


1 ,381 


8.49 


.004 


Sex + Ethnicity 


.097 


3,378 


2.08 


.102 


Sex + Ethnicity + E x S 


.116 


3,375 


2.61 


.051 



Interaction 



Each F ratio is computed only for the last variable entered into the 
regression equation. 

'Tests for covariate by ethnicity interaction, F (3,376) = .42 and 
covariate by sex interaction, F (1,380) = 1.73 were nonsignificant. 
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Table 10. Testwiseness Means Adjusted for Reading 
Scores for 384 Seventh Grade Students 



Ethnicity 


Male 


Female 


Total 


American Indian 


8.96 


10.18 


9.68 


Black 


9.34 


11.90 


11.19 


Hispanic 


9.72 


10.47 


10.06 


Anglo 


9.92 


9.99 


9.95 


TOTAL 


9.77 


10.34 


10.05 


a The regression weight (b weight) used in the adjust- 
ment process was .0372. 


Table 11. Testwiseness Obtained 
Seventh Grade Students 


Score Means 


for 384 


Ethnicity 


Male 


Female 


Total 


American Indian 


10.09 


10.00 


9.41 


Black 


9.20 


11.85 


11.11 


Hispanic 


9.49 


10.32 


9.88 


Anglo 


10.09 


10.28 


10.18 


TOTAL 


9.73 


10.39 


10.05 
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Figure 3. Testwiseness Adjusted Means of Seventh 
Grade Students 

Results of the- investigation of risktaking are contained in Appendices A-C. 

A oneway ANOVA comparing these ethnic groups using' testwiseness scores .as 
the dependent variable would find significant differences at the third grade, 
F (3,160) = 2.75, p = .045; at the fifth grade, F (3,259) = 3.42, p = .018; 
and at the seventh grade, F (3^380) = 3.01, p = .030. However, when reading 
ability is controlled for, there were no significant differences in testwiseness 
among the four ethnic groups. Reading achievement accounted for a significant 
amount of variance in lestwiseness and its control was an important factor in 
this research. 

Using reading scores was also crucial when investigating sex differences. 
Without reading scores as a covariate, a simple oneway ANOVA would yield the 
following: third grade, F (1,162) = 1.08, p = .301; fifth grade, F (1,261) = .081, 
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p = .777; and seventh grade, F (1,382) = 10.93, p = .001. When readinn 
differences were controlled, sex difference appeared at the third grade as 
well as the seventh grade. 

The means of the groups were graphed for visual inspection. There is a 
difference of opinion among researchers as to the proper interpretation of 
significant interactions (Games, 1973; Levin and Marascuilo, 1973; Marascuilo 
and Levin, 1970, 1976; Betz and Gabriel, 1978). In addition, Lubin (1961) 
would argue that it is incorrect to repcrt no significant ethnicity differences 
in the presence of a significant sex by ethnicity interaction (as we did for 
third grade). Rather than argue these issues at this time, we prefer to limit 
our paper to reporting the differences found by using reading scores as a 
covariate as opposed to using obtained TW scores.as the dependent variable. 
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APPENDIX A 

Reading Means Presented by Ethnicity, Grade and Sex a 





Th 


ird 


Fifth 




Seventh 




Ethnicity 


M 


F 


M 




F 


M 




F 


American Indian 


6.50 


10.00 


34.75 


25 


.00 


21.43 


26 


.80 


Black 


15.75 


11.89 


25,00 


21 


.33 


28.00 


30 


.31 


Hispanic 


14.50 


16.49 


38.30 


37 


.10 


25.72 


27 


.73 


Anglo 


13.77 


17.83 


46.27 


50 


.65 ■ 


36.25 


39 


.59 


GRAND MEAN 


15. 


,20 


41. 


,60 




31 


.73 





Sample sizes corresponding to each mean are presented in Table 1. 
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APPENDIX B 



Regression of Risktaking Scores on Ethnicity, Sex and E x S Interaction 
with Reading Scores as Covariate for 164 Third Grade Students 



Source 


R 2 


df 


F a 


P 


Covariate 


.005 


1,162 


.74 


.389 


Ethnicity 


.027 


3,159 


1.24 


.297 


Ethnicity + Sex 


.037 


1 ,158 


1.54 


.217 


Sex 


.018 


1.161 


2.15 


.145 


Sex + Ethnicity 


.037 


3,158 


1.04 


.378 


Sex +. Ethnicity + E x S 


.085 


3,155 


2.70 


.048 



Interaction 



Each F ratio is computed only for the last variable entered into the 
regression equation. 

'Tests for covariate by ethnicity interaction, F (3,156) = .96 and 
covariate by sex interaction, F (1,160) = 1.25 were nonsignificant. 
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APPENDIX C 



Regression of Risktaking Scores on Ethnicity, Sex and E x S Interacti 
with Reading Scores as Covariate for 263 Fifth Grade Students 



Source 


R 2 


df 


F a 


P 


Covariate 


.011 


1,261 


2.87 


.091 


Ethnicity 


.027 


3,258 


1.43 


.234 


Ethnicity + Sex 


.030 


1,257 


.64 


.424 


Se?/? 


.012 


1,260 


.35 


.555 


Sex + Ethnicity 


.030 


3,257 


1.53 


.207 


Sex + Ethnicity + E x S 
Interaction" 


.074 


3,254 


4.07 


.008 


Each F ratio is computed only for the last variable entered into the 
regression equation. 



Tests for covariate by ethnicity interaction, F (3,155) = 1 50 and 
covariate by sex interaction, F (1,159) = .82 were nonsignificant. 



APPENDIX D 



Regression of Riskiaking Scores on Ethnicity, Sex and E x S Interaction 
with Reading Scores as Covariate for 384 Seventh Grade Students 



Source 


R 2 


df 


F a 


P 


Covariate 


.040 


• 1,382 


15.88 


.000 


Ethnicity 


.on 


3,379 


.60 


.615 


Ethnicity-* Sex 


.046 


1 ,378 


.48 


.488 


Sex 


.042 


1 ,381 


.66 


.416 


Sex + Ethnicity 


.046 


3,378 


.54 


.655 


Sex + Ethnicity + E x S 


.061 


3,375' 


2.08 


.102 



Interaction^ 



Each F ratio is computed only for the last variable entered. into the 
regression equation. 

'Tests for covariate by ethnicity inter- ction, F (3,376) = 2.08 and 
covariate by sex interactions F (1,380; = 2.12 were nonsignificant. 
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